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Permeation-tube moisture generators are 
used in industry as calibrated sources of 
water vapor and carrier gas mixtures. 
Measurements were made using three 
permeation-tube moisture generators of the 
type used in the semiconductor industry. 
This paper describes repeatability and 
reproducibility standard deviations in 
measurement of moisture concentration 
from such generators. Repeatability refers 
to measurements within a system and 
reproducibility refers to measurements 
between systems. Two independent 
methods were used to measure the realized 
concentration of water vapor. The first 
measurement, the calculated value, was 
determined using calibrated permeation 
rate of permeation-tube and flow rate of 
dry carrier gas. This is the industrial 
method of evaluating moisture concentra- 
tion. The second measurement, the 
measured value, was determined using the 
low frost-point generator at the National 
Institute of Standards and Technology 
(NIST) and a quartz-crystal-micro-balance. 
Four pairs of independent measurements 



for each generator and for six nominal 
levels in the range from 10 nL/L to 
100 nL/L were made. The characteristic 
used to quantify repeatability and repro- 
ducibility standard deviations in industrial 
measurements is the calculated value 
minus the measured value. Repeatability 
standard deviation ranges from 1 nL/L to 
2 nL/L, approximately. Reproducibility 
standard deviation ranges from 2 nL/L to 
8 nL/L, approximately. The documentary 
ASTM standard E691-99 was used for 
both data vahdation and quantification of 
the repeatabihty and reproducibihty 
standard deviations. 
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1. Introduction 

Permeation-tube moisture generators (PTMGs) were 
used to produce water vapor in a stream of pure nitro- 
gen carrier gas. A PTMG produces a stable flow of 
water vapor permeating through a membrane-tube 
containing liquid water at a constant temperature and 
pressure. The water vapor is mixed with a metered 
stream of dry carrier gas. The concentration of moisture 



is calculated using the permeation rate of water vapor 
and the flow rate of dilution gas as discussed in 
Ref [1]. This type of apparatus is commonly used in 
the semiconductor industry as a portable standard for 
the calibration of hygrometers. 

Another apparatus for producing low levels of mois- 
ture in a stream of carrier gas is the low frost-point gen- 
erator (LFPG) at the National Institute of Standards and 
Technology (NIST), which is based on thermodynamic 
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principles. Compressed gas is purified and passed 
through a long-coiled saturator that is controlled at a 
stable temperature. The gas leaves the saturator com- 
pletely saturated with water vapor in equilibrium at an 
absolute pressure and temperature. Measurements of 
the pressure and temperature within the saturator, along 
with the known relationship between the equilibrium 
water vapor pressure and the temperature of the ice in 
the saturator are used to determine the water vapor con- 
centration. Additional details are given in Ref [2]. 

The object of this study is to quantify the variation in 
measurement of water vapor generated by PTMGs used 
in industry. Two types of variation are of interest: vari- 
ation within a system and variation between systems. 
The Guide to the Expression of Uncertainty in 
Measurement [3] defines repeatability conditions as the 
same conditions of measurement over a short period of 
time and reproducibility conditions as changed condi- 
tions of measurement. The change in this study is the 
use of different PTMG instruments. The terms repeata- 
bility standard deviation and reproducibility standard 
deviation as used here are contractions of "standard 
deviation in repeatability conditions" and "standard 
deviation in reproducibility conditions" respectively. 

Data on the measurement of moisture content were 
collected over a period of 2 years for nominal water 
vapor concentrations of lOnL/L, 20 nL/L, 40 nL/L, 
60 nL/L, 80 nL/L, and 100 nL/L generated from three 
PTMGs. This range of concentration is important in the 
specification of gases such as nitrogen used in the semi- 
conductor industry. The three PTMG instruments are 
labeled here as A, B, and C. The PTMGs were con- 
structed on the same principle but with different hard- 
ware and represent typical PTMGs used in industry. 
They were loaned to NIST for measurement. The 
PTMGs were calibrated at the source, thus they repre- 
sent industrial use conditions. The repeatability meas- 
urements for each instrument were made sequentially 
over a relatively short period of time. The repro- 
ducibility measurements using different instruments 
were made over a relatively long period of time. Thus 
the reproducibility represented here is a relatively 
long-term variation. 

For each nominal level of moisture concentration, 
the actual concentration of water vapor produced by the 
PTMG was determined by two independent measure- 
ment methods. The two measurements are referred to 
here as the calculated value x^ and the measured value 
Xn,. The calculated value x^ was determined using the 
calibrated permeation rate of the permeation-tube and 
the calibrated flow rate of the dry carrier gas. The 
measured value x^ of moisture concentration was deter- 



mined by a standard substitution method using the 
NIST's low frost-point generator (LFPG) and a quartz- 
crystal-micro-balance. We made four pairs of in- 
dependent repeat measurements for each level and each 
generator. 

In industry, the calculated value x^ is used as the 
amount of water vapor concentration produced by a 
PTMG. The measurand, quantity subject to measurement, 
is the actual moisture concentration. Repeatability and 
reproducibility standard deviations are defined for a fixed 
value of the measurand. In this application it is not 
practical to realize a fixed level of moisture. There is 
always some variation in the actual moisture concentra- 
tion about the nominal level. So the characteristic used 
here to quantify repeatability and reproducibility 
standard deviations in industrial measurements is the 
difference 5x = x^-x^^, where x^ and x^^ are the calculated 
and measured values of the same actual moisture concen- 
tration determined simultaneously. This is a different 
scale for quantifying repeatability and reproducibility 
standard deviations. The measured values from the NIST 
LFPG are highly repeatable and they are in effect used 
as reference values to quantify repeatability and repro- 
ducibility standard deviations of PTMG measurements. 

2, Statistical Analysis 

The data on the difference (6x) of calculated value x^ 
from measured value x,^ are presented in Table 1 and 
plotted in Fig. 1. The statistical analysis has two objec- 
tives. First, the data are investigated to validate their 
suitability for quantifying repeatability and repro- 
ducibility standard deviations. Then repeatability and 
reproducibility standard deviations are quantified for 
validated data. We have used the statistical method 
recommended by ASTM standard E691-99 [4] to 
investigate the data as well as to quantify repeatability 
and reproducibility standard deviations. This documen- 
tary standard and its previous editions have existed for 
over 20 years. Despite being very useful, it does not 
seem to have been widely used. One of our objectives 
is to show its utility. The statistical analysis is done 
separately for each level of nominal concentration. 

The objectives of the first part of data analysis are as 
follows. (1) Check for evidence of instrument effects. 
(2) Check whether within-instrument standard devia- 
tions are similar. (3) Check that there are no highly 
discrepant instrument arithmetic means. The four 
measurements for a given nominal level and instrument 
are referred to as a cell. The data is investigated by 
examining the ^-statistic and the /;-statistic for each 
cell. Formulas for the ^-statistic and /;-statistic are 
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Table 1. Data on difference in measurement: calculated value minus measured value 





Nominal concentration 


Test 


Testl 


Test 2 


Test 3 


Test 4 


(nL/L) 


instrument 


(nL/L) 


(nL/L) 


(nL/L) 


(nL/L) 


10 


A 


1.07 


1.42 


1.07 


0.62 


10 


B 


0.79 


0.81 


0.10 


0.88 


10 


C 


-3.26 


-2.20 


-2.43 


-0.83 


20 


A 


0.37 


-0.04 


0.17 


0.23 


20 


B 


0.75 


0.26 


0.26 


-0.61 


20 


C 


-2.57 


-3.06 


-1.78 


-3.46 


40 


A 


0.57 


0.45 


-0.34 


1.39 


40 


B 


0.32 


0.23 


-0.36 


0.16 


40 


C 


-3.59 


-3.17 


-3.19 


-3.89 


60 


A 


0.87 


0.58 


0.86 


1.19 


60 


B 


0.41 


0.64 


0.94 


-0.49 


60 


C 


-4.89 


-6.50 


-4.74 


-4.76 


80 


A 


0.76 


0.35 


1.45 


1.06 


80 


B 


-2.12 


-0.48 


1.60 


-0.49 


80 


C 


-7.33 


-8.76 


-6.83 


-6.28 


100 


A 


5.43 


3.95 


2.50 


5.73 


100 


B 


-2.44 


2.33 


-1.37 


1.44 


100 


C 


-11.91 


-11.50 


-9.93 


-9.89 
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Fig. 1. Difference of Permeation-tube moisture generator (PTMG) measurement called 
calculated value and the NIST low frost-point generator (LFPG) measurement called 
measured value. Some data points overlap. 



given in Appendix A. The ^-statistic is normalized 
within-instrument standard deviation. It is used to 
check whether within-instrument standard deviations 
are similar. The /;-statistic is standardized cell arith- 
metic mean. It is used to check whether any cell arith- 
metic means are highly discrepant. Computed values of 
^-statistic and /;-statistic are presented in Table 2 and 
charted in Figs. 2 and 3, respectively The first impres- 



sion from the chart of ^-statistic is that the within- 
instrument standard deviations are different. However, 
within-instrument standard deviations are based on 
only four measurements, so we can expect large 
random fluctuations among them even when there is 
no instrument or level effect. In view of the small 
number of measurements, we conclude from the chart 
of ^-statistic that within-instrument standard deviations 
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Table 2. Table of A:-statistic and A-statistic 



Nominal concentration 
(nL/L) 

10 
10 
10 
20 
20 
20 
40 
40 
40 
60 
60 
60 



100 
100 
100 



Test 
instrument 

A 
B 
C 
A 
B 
C 
A 
B 
C 
A 
B 
C 
A 
B 
C 
A 
B 
C 



^-statistic 


/?-statistic 


0.506 


0.687 


0.564 


0.460 


1.557 


-1.147 


0.316 


0.583 


1.049 


0.572 


1.341 


-1.155 


1.451 


0.673 


0.626 


0.476 


0.709 


-1.149 


0.399 


0.650 


0.986 


0.502 


1.367 


-1.152 


0.421 


0.716 


1.378 


0.427 


0.961 


-1.143 


0.888 


0.836 


1.349 


0.272 


0.626 


-1.108 




a 10 nL/L 


□ 20 nL/L 


m 40 nL/L 


n 60 nL/L 


SO 80 nL/L 


B 100 nL/L 



Fig. 2. Chart of A:-statistic 
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Fig. 3. Chart of /?-statistic 
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are not widely different. This conclusion is supported 
by the statistical test discussed in Ref. [4], which is 
applicable when the data can be assumed to have 
normal distribution. Thus the repeatability standard 
deviation for a nominal concentration can be computed 
using all data for that level. The chart of /;-statistic 
shows that there is a clear evidence of instrument 
effects and that there are no highly discrepant instru- 
ment arithmetic means. Thus the reproducibility 
standard deviation for a nominal concentration can be 
computed using all data for that level. In summary, the 
data are reasonably valid for quantifying repeatability 
and reproducibility standard deviations. 

Repeatability and reproducibility standard deviations 
are computed using the formulas given in the ASTM 
standard E691-99 and reproduced here in the 
Appendix. The computed values of the repeatability 
standard deviation, denoted by s,, and the reproduci- 
bility standard deviation, denoted by s^ are given in 
Table 3 and charted in Fig. 4. Since the reproducibility 
standard deviation includes the repeatability standard 
deviation, it is always larger. Both the repeatability 
standard deviation s, and the reproducibility standard 
deviation s^ tend to increase with the nominal level. 
This is to be expected and is consistent with previous 



findings about the effect of flow-rate [2] . A quadratic 
polynomial (not shown here) fits well the charts of 
repeatability standard deviation s, and reproducibility 
standard deviation s^ versus the level of nominal con- 
centration. Table 3 also includes arithmetic means of 
the difference (5x) for different nominal concentrations. 
The arithmetic means are small relative to their repro- 
ducibility standard deviations. From Fig. 1, we note 
that the negative values of the arithmetic mean of the 
difference (5x) are largely caused by data from the 
PTMG labeled C. 



Table 3. Repeatability standard deviation, reproducibility standard 
deviation, and arithmetic mean of difference in measurement for six 
levels of nominal concentrations 



Nominal 


Repeatability 


Reproducibility 


Arithmetic 


concentration 


s,(nL/L) 


s^(nL/L) 


mean 


(nL/L) 






(nL/L) 


10 


0.65 


1.85 


-0.16 


20 


0.54 


1.73 


-0.79 


40 


0.49 


2.22 


-0.95 


60 


0.62 


3.43 


-1.32 


80 


1.11 


4.52 


-2.26 


100 


1.68 


7.96 


-2.14 



Repeatability 



Reproducibility 



T3 







20 40 60 80 

Nominal concentration (nL/L) 



Fig. 4. Chart of repeatability and reproducibility standard deviations. 
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3. Conclusion 



5. References 



The graphical investigation of data using the 
^-statistic and the /i-statistic shows that they are reason- 
able to quantify repeatability and reproducibility 
standard deviations in PTMG measurements. Thus the 
repeatability and reproducibility standard deviations 
given in Table 3 should be of interest to the scientific 
and technical community Repeatability standard 
deviation ranges from 1 nL/L to 2 nL/L, approximately 
Reproducibility standard deviation ranges from 2 nL/L 
to 8 nL/L approximately These standard deviations 
quantify possible variation in measurement of water 
vapor concentration generated by typical PTMG instru- 
ments used in the semiconductor industry. 

4. Appendix A. Formulas 

The following formulas are defined for a fixed level 
of the nominal moisture concentration. Let x^j denote 
they'-th measurement for the i-th apparatus, wherey = 1, 
2, . . . , J and / = 1, 2, . . . , /. Here J= 4 and /= 3. Let 
X,- be the arithmetic mean and s^ the sample standard 
deviation of the J measurements. The A:-statistic is 
the square-root of normalized variance ^^^/(i;. 5^^//) 
for /= 1, 2, ...,/. It is used to compare the variation of 
within-instrument standard deviations. Let x be the 
arithmetic mean and s be the standard deviation of the 
arithmetic means Xi, . . . , Xj. The /;-statistic is the stan- 
dardized instrument mean (x,-x)/s for / = 1, 2, . . . , /. 
Both the ^-statistic and /;-statistic are dimensionless 
quantities. The repeatability standard deviation is 

defined as s^ = yjll.sf / 1). This is the denominator of 
the ^-statistic. The reproducibility standard deviation is 

defined as ^^ =max{5^, ^[/ +(1 -1/ J)^']}, Ref [4]. 
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